Compositionality Decomposed: How do Neural Networks Generalise?
نویسندگان
چکیده
منابع مشابه
Evolving Modular Neural Networks Which Generalise Well
| In dealing with complex problems, a monolithic neural network often becomes too large and complex to design and manage. The only practical way is to design modular neural network systems consisting of simple modules. While there has been a lot of work on combining diierent modules in a modular system in the elds of neural networks, statistics , and machine learning, little work has been done ...
متن کاملHow Do Evolved Digital Logic Circuits Generalise Successfully?
Contrary to indications made by prior researchers, digital logic circuits designed by artificial evolution to perform binary arithmetic tasks can generalise on inputs which were not seen during evolution. This phenomenon is demonstrated experimentally and speculatively explained in terms of the regular structure of binary arithmetic tasks and the nonoptimality of random circuits. This explanati...
متن کاملHow Do Neural Networks Overcome Label Noise?
This work provides an analytical expression for the effect of label noise on the performance of deep neural networks. (a) 5 of MNIST’s 10 classes, with clean labels (b) 20% Random Noise, 100% Network Prediction Accuracy (c) 20% Randomly Spread Flip Noise, 100% Accuracy (d) 20% Locally Concentrated Noise, 80% Accuracy Figure 1: Different types of random label noise. DNNs are extremely resistant ...
متن کاملEvolutionary Artiicial Neural Networks That Learn and Generalise Well
Evolutionary artiicial neural networks (EANNs) refer to a special class of artiicial neural networks (ANNs) in which evolution is another fundamental form of adaptation in addition to learning. The evolution in EANNs is often simulated by genetic algorithms (GAs), evolutionary programming (EP), or other evolutionary algorithms. This paper describes an EP-based EANNs which learn both their weigh...
متن کاملRecurrent Convolutional Neural Networks for Discourse Compositionality
The compositionality of meaning extends beyond the single sentence. Just as words combine to form the meaning of sentences, so do sentences combine to form the meaning of paragraphs, dialogues and general discourse. We introduce both a sentence model and a discourse model corresponding to the two levels of compositionality. The sentence model adopts convolution as the central operation for comp...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Artificial Intelligence Research
سال: 2020
ISSN: 1076-9757
DOI: 10.1613/jair.1.11674